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[0010] 

[Mode for Carrying Out the Invention] A system that can 
determine the illumination type or kind for an image in a scene 
can greatly reduce the time and computation necessary to 
determine the actual light source for the scene. By this means, 
it becomes possible to rapidly carry out white balancing of 
a scene by use of the correct illuminant. 

[0011] Photo sensor arrays used in digital cameras typically 
contain red, green, and blue filters arranged in a repeating 
pattern. FIG. 4 shows an actual example of a typical pattern 
used in a photo sensor array. For clarity, FIG. 4 only shows 
photo sensor elements, the number of which is smaller than the 
actual number of photo sensor elements contained in a typical 
photo sensor array. In the typical layout, the repeating 
pattern has one red, one blue, and two green photo sensor 
elements or pixels. These four elements create a super pixel 
that samples all the visible light in the scene for this area. 
By replacing one of the green filters with a filter that only 
allows infrared (IR) light to pass or by leaving off one filter, 
information regarding the type of the light source for the scene 
can be determined. 

[0012] FIG. 5 shows an actual example of the repeating pattern 
containing a red, green, blue, and IR photo sensor elements 
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according to the present invention. For clarity, FIG. 5 only 
shows photo sensor elements, the number of which is smaller 
than the actual number of photo sensor elements contained in 
a typical photo sensor array. 

[0013] FIG. 6 shows a graph of the typical band pass filters 
used for the red, green and blue colors in a typical digital 
camera photo sensor array. The wavelength range of light 
sampled using the red, green and blue filters is typically in 
the range of 410 - 720nm. FIG. 7 shows the preferred embodiment 
of the band pass filter for the infrared filter according to 
the present invention. In the preferred embodiment, the 
filter is narrow with the peak centered approximately at 720nm. 
In another embodiment, the IR filter is broad, and has a peak 
centered approximately at 800nm (see, FIG. 8) . In still 
another embodiment, there is no filter, and light across the 
entire CCD sensitivity is collected (see, FIG. 11) . By using 
the information from the IR element together with the red, green, 
and blue elements, the light source type can be determined. 
[0014] FIG. 9 is a flow chart showing the method used to 
determine the type of the light source for a digital image of 
a scene according to the present invention. The first step 
thereof is to measure the intensity of the red, green, blue, 
and IR light across the image (902, 904, 906, 908) . Then, the 
intensity of the IR light is compared with the average intensity 
of the red, green, and blue light (910) . The aforementioned 
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comparison can be done at each super pixel, or it can be done 
by use of the sum of the pixels across the entire image. In 
the case where the intensity of IR light is much smaller than 
the intensity of the red, green and blue light, the light source 
type will be a light source that creates the light by exciting 
phosphors that reemit visible light (typically a florescent 
lamp) . This is because a florescent lamp does not generate 
much light in the IR band. FIG. 10 shows the red, green, blue, 
and IR filter pass bands overlaid onto the power spectrum of 
a typical florescent light. The intensity of the florescent 
lamp in the wavelength range of the IR filter is much smaller 
than the intensity of the light over the red, green, and blue 
wavelengths of light. Because the light source is not 
producing much light in the IR band, the objects in the scene 
will not reflect much light in this wavelength range. In 
addition, in the case where the intensity of the IR light is 
approximately the same as the intensity of light in the red, 
green, and blue wavelength range, the light source will be one 
of the daylight curves (see, FIG. 2) . In addition, in the case 
where the intensity of light in the IR band is much greater 
than the intensity of the red, green and blue light, the light 
source type will be a tungsten light source (see, FIG. 1) . Once 
the type or kind of the light source has been determined, the 
actual light source can be more quickly determined by use of 
the correlation matrix memory method. 
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